Astronomical Massive Data Processing Technology
نویسندگان
چکیده
منابع مشابه
Starlet Transform in Astronomical Data Processing
We begin with traditional source detection algorithms in astronomy. We then introduce the sparsity datamodel.The starlet wavelet transform serves as ourmain focus in this chapter. Sparse modeling, and noise modeling, are described. Applications to object detection and characterization, and to image filtering and deconvolution, are discussed. The multiscale vision model is a further development ...
متن کاملOpenCluster: A Flexible Distributed Computing Framework for Astronomical Data Processing
The volume of data generated by modern astronomical telescopes is extremely large and rapidly growing. However, current high-performance data processing architectures/frameworks are not well suited for astronomers because of their limitations and programming difficulties. In this paper, we therefore present OpenCluster, an open-source distributed computing framework to support rapidly developin...
متن کاملArchitecture of processing and analysis system for big astronomical data
This work explores the use of big data technologies deployed in the cloud for processing of astronomical data. We have applied Hadoop and Spark to the task of co-adding astronomical images. We compared the overhead and execution time of these frameworks. We conclude that performance of both frameworks is generally on par. The Spark API is more flexible, which allows one to easily construct astr...
متن کاملParallel Astronomical Data Processing with Python: Recipes for multicore machines
High performance computing has been used in various fields of astrophysical research. But most of it is implemented on massively parallel systems (supercomputers) or graphical processing unit clusters. With the advent of multicore processors in the last decade, many serial software codes have been re-implemented in parallel mode to utilize the full potential of these processors. In this paper, ...
متن کاملData-Mining Massive Time Series Astronomical Data Sets - A Case Study
In this paper we present a new application of data mining techniques to massive astronomical data sets. Previous data mining applications deal with time-independent m ultiple spectral astronomical data 22. We are concerned with time series astronomical data. More precisely, our data consists of N time series, each with a duration of M days. The data set can be viewed as an NM matrix in which r ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Advances in Astronomy
سال: 2020
ISSN: 1687-7969,1687-7977
DOI: 10.1155/2020/6848935